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Technical Field of the Invention 

The present invention provides a process and an apparatus for (1 ) facilitating patient 
and professional health care provider interaction and communication about a diagnosis that 
requires a professional decision, and (2) providing patients with a means for making their own 
health care decisions by empowering patients with the means for potential self diagnosis of 
symptoms. 



Background of the Invention 

Health care Internet sites have been among the most rapidly growing Internet 
destinations in terms of consumer/user visits. Such sites offer medical and health care 
information in the form of news, medical literature or library resources on-line. Often the 
information is organized along disease lines to facilitate advertising directed at target audiences 
and to facilitate formation of "chat" or other on-line discussions or support conversations 
among interested users. 

A patient or user of the traditional on-line health sites looking to understand or 
diagnose a medical situation would require the patient to explain his or her symptoms and then 
25 read through discussion of various diseases in a medical reference text (or even an on-line 

version) while attempting to match his or her symptoms to a disease. This process is much like 
shopping for items in a grocery store by looking solely at the list of ingredients on package 
labels and then attempting to find a desired item by locating the matching list of ingredients. 

Common tools used to determine probabilities in the clinical research and disease 
management area have typically revolved around probabilities associated with sensitivity and 
specificity. Sensitivity is defined as the proportion of false negatives we should expect of 
people 
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that truly have a disorder. Specificity is defined as the proportion of false positives among 

those without the disease. 

Therefore, despite the proliferation of on-line health care information sites, there is a 

need to provide an on-line diagnostic system for helping to match symptoms to potential 

5 diseases or diagnoses such that a patient can obtain information for traditional sources prior to 

a visit to a health care professional. 

Summary of the Invention 

The present invention provides a process for facilitating patient self-diagnosis of 
10 symptoms comprising the steps of: 

(a) providing a plurality of entry points that are symptoms that the patient will 
indicate are present; 

(b) providing a plurality of disease categories that the patient will check are related 
to the symptoms indicated in step a; and 

1 5 (c) reporting a series of possible diagnoses and probabilities of such diagnoses. 

Preferably, each diagnosis is linked to a series of warnings if a possible disease requires 
urgent treatment. Preferably, each diagnosis is linked to a disclaimer statement. Preferably, 
the process further comprises a step to provide any information of medications being taken, 
wherein possible side effects can be linked to the medications. 

20 The present invention further provides an apparatus or server system for implementing 

a patient self-diagnosis service over a wide area network means of communication, wherein the 
server system comprises a central processing unit, ROM, RAM, and a data storage device, 
wherein the data storage device comprises one or a plurality of databases selected from the 
group consisting of a symptoms database, a disease category database, a medications database, 

25 a diseases database, a health insurers/systems database, a professionals database, and 
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combinations thereof, wherein the symptoms database, the disease category database, and the 
diseases database must be present. 

The invention further provides a process for designing an algorithm for evidence-based 
medicine differential diagnoses, comprising: 

5 (a) Providing a presenting symptom or group of symptoms; 

(b) determining evidence-based probabilities for each diagnosis from medical 
literature or clinical experience sources; 

(c) merging the probabilities with aggregated data into decision alternatives; and 

(d) listing first and preference values as algorithm branchpoint choices. 
10 In a further embodiment, the method for determining a diagnosis includes: 

(a) providing symptomatic information; 

(b) analyzing the symptomatic information using a likelihood ratio algorithm; and 

(c) determining a diagnosis based on a resulting calculation of the likelihood ratio 
algorithm. 

15 One advantage of the present method is the ability to construct greater than "2x2" 

tables. The method may be used in all patient populations regardless of prevalence, thereby 
freeing the for the evaluation of more than two alternatives or outcome possibilities and/or 
more than two variables or levels or categories of test results and/or symptoms. 

Another advantage is the ability to link results of different, independent tests in 
20 succession by the multiplication of individual likelihood ratios. 

Brief Description of the Drawings 

Figure 1 illustrates a PSDS Controller in a block diagram format showing an 
embodiment of the computer controller of the PSDS interface. 
25 Figure 2 shows a first page of a decision tree that begins with the symptom of chest 
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pain. This tree goes down ihc routes of tenderness with palpation and no tenderness with 
palpation. Possible diagnoses are listed at the bottom of each tree or a link for additional 
information. 

Figure 3 utilizes additional information as to whether or not a change in the symptoms 
happened with administration of an antacid. The medication database is factored into the 
decision tree at the left. 

Figure 4 shows a further continuation of the decision tree of Figure 3 with additional 
possible diagnoses listed across the bottom. 

Figure 5 shows a continuation of the decision tree of Figure 4. 

Figure 6 shows a simple schematic of how a symptom-based algorithm is designed. 

Figure 7 shows a template algorithm for business to business. 

Figure 8 shows a flow chart of the front page of a web site utilizing the method of the 
present invention. 

Figure 9 shows a flow chart of the heuristics underlying a web page of a branch tree. 
Figure 10 shows a flow chart of the heuristics underlying a web page of a tabular 
algorithm 

Figure 1 1 shows a flow chart of the heuristics underlying a web page of a template for 
determining a likelihood ratio of the present invention. 

Figure 12 shows a flow chart of administrative/tabular algorithm building. 
Figure 13 shows a flow chart of the diagnostic template. 

Figure 14 shows a flow chart of the heuristics of tabular algorithm calculation. 

Detailed Description of the Invention 

As will be made clear below, the general availability of personal computers and of the 
Internet and the advent of the present invention make possible mechanisms to enable and 
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encourage influential consumer-directed transactions of the kinds described above and to 

increase the efficiencies of health care professionals' education activities and of 

manufacturers' marketing activities. 

Definitions 

5 Consumers shall mean to individual consumers or potential consumers of health care 

products and services, also to the responsible guardians of minors or of legally incompetent 
individuals, and also to the owners of animals receiving or potentially receiving veterinary 
care. 

Professionals shall mean all health care professionals who have prescriptive authority 
1 0 (such as physicians, nurse practitioners, physicians' assistants, dentists, and veterinarians) or 
have influence (such as nurses, therapists, pharmacists, and chiropractors) in the choice and 
prescription of products. 

Health Care Systems shall mean the administrative or business units in the vast network 
of managed care and insurance reimbursement systems and includes, for example, health 
15 maintenance organizations (HMOs), managed care providers, health insurance programs, 
pharmacy benefit managers, and other provider or payor based programs that can control, in 
any way, the dispensing of health care services. 

Doctor shall mean any health care professional with prescriptive authority or influence 
for health care products or services. 

20 Governmental Regulators and Governmental Administe torj refer to those individuals 

who either regulate or approve (or deny) the marketing of products by manufacturers or 
services (e.g., Food and Drug Administration), or those State (Insurance Commissioner) or 
Federal (Health and Human Services) agencies that regulate which products or services must 
be provided or reimbursed in health care systems (e.g., HMOs) or federal health benefit 

25 systems (e.g., Medicare and Medicaid). 
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Network Architecture 

The componenls of a preferred embodiment of the present invention are illustrated in 

Figure 1 . A standard personal computer or computer workstation with adequate processing 

power and memory may be used as PSDS Controller 400. In one embodiment it operates as a 

5 web server, receiving and responding lo consumer requests for access to PSDS services. PSDS 

Controller 400 must be capable of rapidly performing database queries as well as handling 

input and output needs. A Sun Microsystems 300 MHz UltraSparc II processor may be used 

for CPU 405. A similar processor such as a 500 MHz Compaq Alpha 21 164 or 450 MHz Intel 

Inc. Pentium II may also be used. 

10 Cryptography processor 460 may be configured as part of CPU 405 or utilize a 

dedicated processor such as a Semaphore Communications Roadrunner 284 or VLSI 

Technology 6868. Cryptography processor 460 is used to encrypt potentially sensitive data 

during transfer between the PSDS Controller 400 and a consumer's computer. 

Operating system 450 provides application software 455 with interface to CPU 405, 

1 5 data storage devices 420, RAM 430, ROM 440, clock 445, and communications interface 470. 

In one embodiment, operating system 450 may be a commonly available system such as Sun 

Microsystems' Solaris 7. Possible alternatives include Microsoft Corporation's Windows NT 

Server or Compaq's Digital UNIX. 

Application software 455 consists of software needed to carry out functions of central 

20 controller 400. This software may include database management software, such as Oracle 

Corporation's Oracle8, web server software such as Netscape Communications Corporation's 

Enterprise Server, and custom-developed applications needed to handle consumer requests 100 

for access to CDPI services. 

Data storage device(s) 420 consist of storage media such as hard disk magnetic storage, 

25 magnetic tape, or CD-ROM drives. Data storage device(s) 420 consist of databases used in the 
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processing of transactions in ihc present invention. In the preferred embodiment, these 

databases consist of a Systems Database 421. a Disease Category Database 422. a Medication.* 
Database 423. a Diseases Database 424, a Professionals Database 425. and a Health 
Insurers/Systems Database 426. Software such as the aforementioned OracleS may be used to 
create and manage these databases. Data storage device also contains operating system 450 
and application software 455. 

The Symptoms Database 421 contains a series of decision trees that start with a 
symptom, such as chest pain or a stomach ache or lower back pain and lead to possible 
diseases underlying the manifestation of the symptom. The fields of each decision tree, 
starting with a symptom or a cluster of symptoms, have inputs for likely disease category from 
the disease category database 422 (having overlapping fields for symptoms) and from the 
medication database 423 having overlapping fields for symptoms resulting from medication 
effects and side effects. This information in the symptom database can be entered by data 
transfer, or keyed entry by PSDS personnel, or by other systems for data input. 

Disease Category Database 422 contains information about the diseases and 
accompanying symptoms but grouped by organ or body system categories, such as renal or 
gastrointestinal or cardiac related to the organ or system having a potential disease. It contains 
information fields such as symptoms, diseases and probabilities of outcomes. This enables 
updating of diagnoses related to symptoms with experience and with new medical information. 
This information is automatically stored by application software 455. 

Medications Database 423 contains data on each prescription and non-prescription 
medication and sorted by dosage, routes of administration, drug indications and drug side 
effects, wherein the drug indications and drug side effects fields are listed according to 
symptom terminology. This information is automatically stored by application software 455 
whenever a transaction takes place. 

7 
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Diseases Database 424 contains data on each disease, its probability ofoccurrcncc, 

severity and symptoms associated with each disease. The Diseases Database will also contain 

links to disease-specific websites to allow one to obtain more information. 

Professionals Database 425 contains data on all professionals with whom the PSDS has 

5 had or has been directed to have contact. It contains fields such as a unique key, name, 

address, phone number, e-mail address, practice location, specialty type, disease states and 

products specified by consumers to be of interest, "cookies'* placed in the professionals' 

computer memories by PSDS Controller 400, etc. 

Health Insurers/Systems Database 426 contains data on which health insurance 

1 0 companies cover (provide reimbursement or payment for) which products and services. It 
contains fields such as a unique key, insurer name, geographic areas, plan and policy types, 
covered products, disease states indicating covered use, professionals participating in the plan, 
etc. Related to health care systems, similar information fields are filled and maintained, 
including formulary inclusion/exclusion information, criteria, text of available 

15 policies/procedures, etc. This information may be entered by PSDS personnel, manufacturers' 
personnel, or electronic transfer from external data sources. It may include consumer-entered 
reports of experiences with insurers and health care systems. 

Communications Interface 470 is the connection through which the central controller 
400 communicates with the Internet. In a preferred embodiment, Communications Interface 

20 470 is connected using high-speed data lines such as Tl or T3 lines to the Internet. In this 

preferred embodiment, communications will be handled by commercial web server hardware 
and software, assisted by custom software. Communications Interface 470 may also be 
configured other ways such as an interactive telephone response system or electronic mail 
automated messaging system. 

25 Although the above embodiment describes a single computer, the Central System 
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Controller 400 functions may be distributed across more than one computer system. In anoth 

embodiment, the central controller might consist of separate systems each handling a specific 

task, such as a database system and a web server system. Multiple systems may also be used 

each role to provide redundancy in case of connectivity or hardware failures. 

Evidence-Based Medicine 

The inventive Internet process utilizes an evidence-based medicine approach as useful 
to health care providers in helping a patient make a diagnostic or a therapeutic decision. By 
contrast, "traditional medicine" comprises four assumptions. The first is that individual 
clinical experiences provide the foundation for diagnosis, treatment and prognosis, with the 
measure of authority being proportional to the weight of individual experience. The second 
assumption is that pathophysiology provides a foundation for clinical practice. The third 
assumption is that traditional medical training and common sense are sufficient to enable a 
physician to evaluate new tests and treatments. The fourth assumption is that clinical 
experience and expertise in a given subject area are sufficient foundation to enable a physician 
to develop clinical practice guidelines. 

Evidence-based medicine, by contrast has three assumptions. The first is that when 
possible, clinicians use information derived from systematic, reproducible and unbiased studies 
to increase their confidence in the true prognosis, efficacy of therapy and usefulness of 
diagnostic tests. The second is that an understanding of pathophysiology is necessary but 
insufficient for the practice of clinical medicine. The third is that an understanding of certain 
rules of evidence is necessary to evaluate and apply medical literature effectively. The 
framework of evidence-based medicine has been used for decision-making techniques to 
support managed care. The decision-making is rigorous in construction and supported by 
statistical models. The principles of evidence-based medicine are preferably employed in the 
algorithms used to design the decision-tree databases described herein. 



0133378A1_I_> 




WO 01/33378 PCT/US00/29648 

The present algorithms provided herein arc formed hascd upon statistical probabilities 

for diagnoses. For example, for a given medical problem or symptom, one generates a 

differential diagnosis. Before any test is performed, each diagnosis in a differential is a 

probability of being present, also called a pretest probability. Once a test is performed, the 

5 probabilities may change for a particular diagnosis to be present. The process of refining 

probability helps the health care provider to determine the likelihood of each given disease 

process in a differential, to assist in making a diagnosis. 

The inventive process uses disease and symptom-based algorithms made up using the 

vast body of medical literature in the form of sensitivities and specificities as values in relation 

10 to systems, physical findings, test results and therapies. Using mathematical tools employed 
by statisticians (e.g., statistical analysis), sensitivities and specificity's can be converted to 
likelihood ratios (LR), odds and ultimately probabilities. Thus, a chain of "likelihood ratios" 
can be multiplied to produce a product, wherein the product represents accumulated 
probabilities. The algorithms come in two fashions, a branchtree and a table. Table 

15 algorithms list alternative diagnoses for a given symptom in order of likelihood, with assigned 
probabilities. Branchtree algorithms are followed through and ultimately lead to a discrete 
diagnosis, so long as branchpoint choices are made. If a user is unable to make a branchpoint 
choice, a user will have to proceed down both sides of a branchpoint to result in numerous and 
disparate alternatives, especially if the point of indecision was relatively early on the 

20 branchtree. Branchtree algorithms work better in a perfect world having clear-cut symptom 
identification and association. Branchtree algorithms establish likelihood of different 
diagnoses based upon answers to multiple questions along an algorithm. The questions asked 
are clinically relevant pieces of data that are related to the presence or absence of disease in the 
algorithm. Relative probabilities can be constructed by analyzing the medical literature to 

25 extract data that leads to probability of a specific disease being present in view of certain 

10 
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symptoms and associated exam findings and test results. 

In view of the inventive process being Internet-based and that such inventive 
algorithms may be followed before a health care professional may be consulted, the internet 
site will need to contain disclaimers that such an inventive algorithm is not meant to replace 
5 traditional health care delivery or serve as a basis for self-treatment absent a health care 
provider's recommendation. 
Algorithms 

The algorithms used according to the inventive process are based upon an initial listing 
of a symptom or symptoms. According to the schematic shown in Figure 6, the symptom or 
1 0 symptoms lead to a choice of disease or categories of disease. A disease that can be provided 
at the ending branch of a branchtree form of algorithm will contain links to expanded data 
bases for more detailed information, including links to specific disease-oriented web sites to 
obtain more detailed information and even participate in support groups. Categories of 
diseases requires a further determination and more likely further testing that will require a 
15 health care provider intervention. Thus, branchpoints will often end in links to systems, such 
as authorization for insurance reimbursement for procedures, possible triage for urgent 
situations, health insurance questions, cost analyses to persuading third party payors of the 
economic benefits of further diagnosis and early treatment, medication alternatives and centers 
of excellence that specialize in certain categories of diseases. Each leads to treatment 
20 alternatives, once a disease has been identified. 

The algorithms herein utilize likelihood ratios. A likelihood ratio is a clinically 
relevant method of reporting accuracy, and calculating the probability of having a disease after 
a positive or negative test. A likelihood ratio expresses results in terms of the probability of a 
patient having a disease. The likelihood ratio takes into account prevalence in the population 
25 of the disease and therefore the resulting ratio does not vary with variance in prevalence in the 
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population. Likelihood ratios express results in terms of odds. The odds are the probability of 

an event occurring divided by the probability that it will not occur. The odds are similar to the 

probability when the event is rare but as the event becomes more common it is necessary to 

switch back and forth between probabilities and odds as shown in the following equations: 

5 Odds = probability / (J- probability) 

Probability = odds /(I + odds) 

The likelihood ratio can be derived from sensitivity and specificity according to the following 

formulas: 

Likelihood ratio for a positive test result (LR+) = sensitivity / 1- specificity 
10 Likelihood ratio for negative test result (LR-) = 1- sensitivity / specificity 

The odds of the disease being present after the test can then be derived from the following 
equation: 

Post-test odds ~ pre-test odds x LR 
Likelihood ratios can be used to determine the relationship of a variable, which is 
15 something measurable, to an outcome. For example, one variable useful in determining the 
presence or absence of a disease state is the usefulness of a screening test. For example, 
likelihood ratios can be used in determining the usefulness of Helicobacter pylori (H. pulori) 
serologies in the determination of the absence or presence of peptic ulcer disease. In a further 
example, one variable useful in determining the length of a hospital stay is signs or symptoms 
20 as indicators of the extent or severity of the disease. For example, the percent oxygen 
saturation in hospitalized Chronic Obstructive Pulmonary Disease (COPD). 



Variable 
<aho referred to as Criterion) 


Outcome 


Example 


I. 


Symptom association 


DDx of a symptom 


Whether n/v in setting of c best pain 
suggesting a cardiac or Gl etiology 
(algorithms) 


2. 


Usefulness of a screening test 


Disease 


H. pylori serologics in peptic ulcer 
disease 
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.1 


Sij»n or symptoms as indicator ol extent ami/or seventy ot disease 


Hospital length ot stay 


Percent oxygen saturation in 
hospitalized COI'l) patients 


•4. 


1 est result 


Disposition 


Leukocytosis in diverticulitis patients 
to determine in-patient w imt-pulK.nl 
management 



Table \ 

I. DEVELOPING LIKELIHOOD RATIOS FOR DISEASE MANAGEMENT 

A. Building a custom algorithm using a "template" 

5 The heuristics involved in formulating a custom template accessible to a user on a 

website is shown in Fig. 1 1 . From the template, the outcome "to be improved" is chosen, and 
is categorized into different alternatives (choices). The outcomes are "factual statistical 
events" that are documented, such as a diagnosis, hospital length of stay, inpatient versus 
outpatient workup, etc. Criteria, also known as variables, that may impact on the outcome are 
1 0 chosen such as test result possibilities or symptom parameters. Categories within each 
criterion are known as criterion values. 

B. Available templates 

The following table shows the criterion or variable as either a positive or negative test 
result. The outcome is either a positive or negative outcome, such as the presence or absence 
15 of a disease state. The following "2x2 table" shows two possible alternatives in the rows 

which are then multipliable by the two possible criterion and/or variables in the columns. The 
results determine the sensitivity and specificity for each of the two criterion values for each of 
the two alternatives. A classic "2x2 table" used to develop likelihood ratios is as follows: 



Outcome 


positive test 


Negative test 


Positive alternative 


a 


c 


Negative alternative 


b 


d 



Table 2 
13 
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The following formulas arc used to determine sensitivity/specificity for each of two 
criterion values for each of two alternatives: 

Sensitivity = a/a+c 
Specificity = d/b+d 

Likelihood ratios are Then determined as follows: 

LR(positive) = likelihood of a positive test in patient with alternative 

likelihood of a positive test in patient without alternative 

LR(positive) = (a/a+c) + (b/b+d) 

or otherwise stated as: 

LR(positive) = sensitivity/1 - specificity 

LR(negative) = likelihood of a negative test in patients with alternative -s- 

likelihood of a negative test in patients without alternative 

LR(negative) " (c/a+c) + (d/b+d) = 1 - sensitivity 

specificity 

C. Beyond the simple "2x2 table" situation having two possible variables and/or 
criteria are situations wherein there are a plurality of possible criteria and/or variables 
5 for a possible outcome. The following table represents a situation where there are more 

than two variables or criterion; such as variables beyond a positive or negative test, and 
the determination of likelihood ratios from the tables: 



Criterion/Variables 




1 


2 


3 


4 


Totals 


Alternative A 




Y 






Z 


Alternative B 




X 






a 




"able 3 



The likelihood and ratios are determined as follows: 
LR + X = (X/a) + (y/z) 
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LR-X 



(u - X/a)+ (2-Y/Z) 



In a further scenario, situations occur where there are a plurality of both criteria and/or 
variables and a more than two possible outcomes. The following table represent a situation 
where there are both greater than two criterion and/or variables and/or greater than two 
possible outcomes and/or alternatives: 







Criierio 


n Values ~~ ~ " ~ — ' 


Totals 


Outcome 
Alternatives 

Totals 




1 


2 


3 


4 




A 












B 




X 






Q 


C 












D 


















P 









The likelihood ratios are determined by the following equations: 
LR + X = (X/a) * (p-X/u -a) 

LR ~ X = (a- X/a) + (u - a) - (p-X)/n - a) 

Likelihood ratios (preference value) are computed for each criterion value. Then 
certain likelihood ratios of greatest significance are chosen which can be placed in succession. 
1 0 The likelihood ratios highest in value (positive or negative) are linked. This will alter most 
pretest probabilities, resulting in the greatest impact on outcome. Those LRs then determine 
which criteria and criterion values should be included into a custom algorithm. The following 
ratios apply: 

series of positive LRs to confirm association 
series of negative LRs to confirm disassociation 
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The pretest probabilities of each alternative are determined by dividing the number 

within an alternative of an outcome by the total number within an outcome. The pretest odds 

of each alternative are computed by the following relationship: 

odds = p/l-p 

5 The pretest odds by chosen LRs are multiplied to determine the post test odds of each 

alternative. The post test probabilities are determined by the following relationship: 

post test probabilities = odds/1 +odds 

If probability observed (actual) varies from "acceptable level" of probability expected 
(calculated previously from database), there is then a discrepancy of "Observed vs Expected" 

10 that requires clarification and may represent opportunity for disease management. The process 
of disease management includes "breaking down" the case(s) under review to evaluate which 
specific factors (LRs) are outside an acceptable range and therefore responsible for the 
discrepancy. Such a process can be utilized by both integrated delivery network (IDN) and 
payors to assess interpractitioner variability, patient demographics, hospital specific 

15 determinants, and consultation patterns, thereby influencing outcomes. 

Analysis of significant data by payors will be necessary over the next several years to 
reach consensus. The method of the present invention facilitates the collating, interpreting and 
communicating of such data. An example procedure is chosen for evaluation: 
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Volume of cases al Hospitals per year: 



<5() 



51-1 00 



101-150 | 151-200 



Survival , high ' 
< 30 days 



201-250 



Survival 
>30 davs 



low 



Likelihood ratios decrease 



-250 



low 



Totals 



B 



C 



D 



Z 



Likelihood ratios increases 



hiith 



Table 5 

The following formulas are used to calculate likelihood ratios: 

LR (X) = number of patients in hospitals <50 cases who died/total deaths ~ number of 
patients in hospitals <50 cases who survived/total survivors 

LR (X) = X/Z/G/a 

The calculations follow the calculations discussed above in the section "likelihood 
rations: Building a custom algorithm using a template." Note that the table above is an 
adaptation of Table 2. 



10 



As the data becomes available, payors will develop alliances with certain IDNs. 

II- THE ANALYSIS OF PATIENT SELECTION FOR CARDIAC 
CATHETERIZATION 



The process of the present invention can be used to streamline the quality assurance- 
process by an integrated deliver network (IDN) or payor. 
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A. Interpractionioner variability 

Understanding that patients require referral for cardiac catheterization, usually by an 
internist/family practitioner to a cardiologist, and then cither sclf-rcfcrral or to an invasive 
cardiologist, the role of Interpractionioner variability requires evaluation. 
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5 Table 6 



An IDN with a risk contract or a payor would attempt to limit catheterizations by 
optimizing clinical approaches and by utilizing less expensive, less risky, non-invasive testing. 
The likelihood ratios dependent on the physician as the variable are based on the following: 

LR(x) = LR of Physician 1 's patients <40 years presenting with chest pain ultimately 
1 0 having a cardiac catheterization showing insignificant coronary disease. 

= x/a/p-x/|a-a 

LR(x) = LR Physician 2's patients <40 years presenting with chest pain ultimately 
having a cardiac catheterization showing insignificant coronary disease. 

= C/a/K-C/^-a 
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B. Assessment of Additional Factors 

One can assess the value of other criteria in determining why the patient is sent Tor 
cardiac catheterization by constructing similar tables and calculating their likelihood rates. 
Those similar tables may include the variables of result of radionuclide cardiac scanning, 
5 stratified, continued symptoms despite maximal medical therapy, utilization of resources such 
as recurrent ER visits and/or hospitalizations, and/or insistence by patient or family on having 
the cardiac catheterization performed. These factors may be evaluated independently. Outliers 
and major determinants such as education/behavior modification of patients, 
education/behavior modification of physicians, and policy/guidelines institution, will be 
10 immediately identifiable and can be acted on. 

C. Integration of decision-making process 

AH independent criteria can now be joined in succession to determine the "collective" 
contribution to the overall decision to or not to catheterize. 

D. Additional Non Medical Applications for Likelihood Ratios 

1 5 The likelihood ratios and process described herein has applicability beyond medical 

diagnosis. As shown in Fig. 7, for example, but not limited to, the likelihood ratios and 
process described herein can be used to determine likely donor suitability by philanthropic 
organizations and other general business applications like determination of possible audit by 
the IRS. In the embodiment to determine likelihood of contribution to philanthropic 

20 organizations, individuals who are likely to contribute can be identified by certain attributes. 
These attributes may include, but are not limited to, where the individuals live as determined 
by their postal code, organization of which they are members, their income, their professions, 
and the schools attended by their children. These, and others, are attributes that may be 
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requested in the likelihood ratios. From these attributes, a likelihood ratio table is constructed 

as follows: 
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Table 7 

From the above table, the likelihood ratio can be calculated as follows for a particular 
zip code: 

LR (zip code) = x/a/p-x/ji - a 

The above is repeated for other attributes and the significant LR are collected. The pre- 
test probability is determined as discussed above. From this, the equation for probability of 
contribution is assembled using the following: 

Pre-test odds x LR x LR 2 x LR 3 , ... = post-tests odds 

Post test odds/ 1+ odds = probability of contribution 

A certain probability can be chosen and those individuals which result above the 
threshold should be contacted first. 

Figure 6 provides a basic schematic flow chart showing a data processing methodology 
and structure according to the inventive process. Each algorithm is constructed by evaluating 
several variables, quantifying and combining these data, based upon probability theory to 
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generate diagnosttc alternatives. The independent probabilities involved in each branchpoint 

or decision step are constructed from references in the medical literature and supplanted by 
practices of experienced clinicians. The process for constructing such decis.on points and 
arriving at probabilities involves either a detailed search of medical literature references for 
5 actual sensitivities or specificities to determine probabilities (using meta-analysis studies) or 
use criteria where the potential for one choice over another is done with regard to a certain 
diagnosis is overwhelming. In other words, there are clinical scenarios that are so intuitive that 
evidence-based medicine has seen no reason to study them statistically, such as right upper 
quadrant abdominal pain and an abnormal liver function blood test indicating hepatic of biliary 
10 tract disease. In the situation where there is a lack of available published data but there is a 
clinical significance of one choice versus another choice, an arbitrary preference can be 
assigned to each of the two choices based upon clinical experience. Even if the actual 
probability, if it were to be studied, would be different, such experienced based values based 
upon office practice data can support uses in the inventive algorithms. Most assigned 
1 5 probabilities, however, will be evidence based. 

The probability value is higher for an alternative closer to an "ideal solution" described 
in a branchtree algorithm, wherein all symptoms and branchpoint choices perfectly match the 
description of the user/patient, and lower for others such that it can be used to evaluate and 
order alternatives. 

20 The following example looks to begin with a single symptom chest pain, and examine 

the various alternatives and probabilities. This will follow a hypothetical user/patient to an 
inventive website using the inventive process seeking to leam more about his or her own 
condition, manifest only as chest pain. Given that the chest pain is identified as an emergency, 
and there are possible cardiac etiologies, the patient/user is advised to go immediately to the 

25 emergency room (ER). In one scenario, the patient/user is evaluated in the ER and deemed to 
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be non-cardiac, and sent home with a prescription lor an H2 blocker, Zantac"* . The 

patient/user will be told that he or she has "a bad case of indigestion" and the rest of the 
algorithm will follow along non-cardiac branches. The patient/user will return to the algorithm 
as he or she was likely unsatisfied with the unceremonious treatment or care he or she received 
as well as an ER charge, and will reach a branch point ultimately leading to a diagnosis of 
"gastroesophageal reflux disease." The reaching of the diagnosis will provide links to leam 
more about this disease, including a database of available treatments and alternative 
medications available for more informed choices. The linking databases can further discuss 
medical versus surgical alternative treatments for such reflux disease and other options that 
may exist and the likelihood of managed care providers paying for such treatments. 

The "trip down the algorithm" is printable and available to transmit electronically to 
ones heath care provider. This allows the exercise to provide valuable information to the 
health care provider in taking a history for a new patient or for the symptoms presenting. The 
information presented substantiates the need for an appropriate level of care sought from third 
party payors, provides authorization for needed testing (e.g., UGI series and eventual 
endoscopy) and can streamline office practices. Other linking options include information for 
user/patient decision making, including an evaluation of different regional centers in success 
rates of laparoscopic nisssen fundoplication and state-of-the-art surgery for refractory 
gastroesophageal reflux disease. There may also be a review article link to an article 
describing an association between longstanding heartburn and esophageal cancer to raise a 
level of concern to obtain treatment. There can be links to pharmaceutical company product 
websites to discuss medication alternatives to the Zantac prescription and to specific online and 
brick-and-mortar pharmacies to advertise competing prices for a particular medication. In 
summary, a "chest pain symptom" can lead to potential treatment and a starting point for on- 
line health care information based upon diagnoses achieved by seeking proper care in a 
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potentially emergency situation. 



Chest Pain Embodiment 

In one embodiment of the present invention, illustrated in the decision trees of Figures 
5 2-5, a chest pain symptom is diagrammed. In the case of chest pain being a symptom of a 
potentially urgent disease (myocardial infarction), will have an advisory posted before the 
consumer is led through the decision tree of Figures 2-5. One example of such an advisory is 
as follows: 
Please be advised 

10 1 ^ unexplained chest pain, particularly though not exclusively in an individual 

with certain risk factors, must be considered as potentially cardiac until proven otherwise. 

2. Any acute or sudden chest pain requires urgent evaluation in an appropriate 
setting, such as an emergency room of a hospital. 

3 . Chest pain, though atypical in its description, still indicates cardiac disease 
1 5 category. 

4. Although a cardiac disease may be ruled out, there are other potentially life- 
threatening causes that require immediate consideration for a person who is acutely (suddenly) 
ill. Thus a user/patient following the exemplary algorithm of "chest pain" should follow the 
above-noted concepts and act accordingly, particularly at asterisks and in boxes. 

20 5 • Though certain diseases have characteristics that are classically associated with 

them, such characteristics are occasionally absent. Therefore, one may benefit from following 
adjacent algorithms as well as the one that strictly follows the user's/patient's own individual 
symptoms. There will be language advising that if a user/patient needs to follow two or more 
diverging pathways because of an inability to make a decision at a decision-based branchpoint, 

25 one should follow a potentially more serious pathway first, (cardiac, pulmonary). 
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Substernal chest pain that is sharp and stabbing, rather than deep, is less likely 



to be cardiac in etiology (though possible). 

In Figures 2-5, a detailed decision tree is provided that has places for additional 
considerations of disease categories based on patient history and for medications wherein the 
5 symptom may be the result of a medication side effect rather than an underlying disease, or the 
side effect is causing an underlying disease. 

Within Figures 2-5, a substernal deep pressure precordial pain, or cardiac-type pain, is 
described as a pain across anterior thorax that is generally with maximal intensity in the 
xiphoid region. The pain is deep, squeezing, tightness or pressure. The pain is poorly 
10 localized and radiates to the neck and arms. Due to interconnecting nerve pathways involving 
various organs, the location of pain is this area indicates a source somewhere within the chest 
and upper abdomen. There are also risk factors for a heart attack to consider. These include 
high blood pressure, diabetes, high cholesterol, previous heart attack or heart disease and a 
family history of heart disease. 
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I claim: 

5 1 . A process for facilitating patient self-diagnosis of symptoms comprising the 

steps: 

(a) providing a plurality of entry points that are symptoms that the patient will 
indicate are present; 

(b) providing a plurality of disease categories that the patient will check are related 
1 0 to the symptoms indicated in step a; and 

(c) reporting a series of possible diagnoses and probabilities of such diagnoses. 

2. The process of claim 1 wherein each diagnosis is linked to a series of warnings 
if a possible disease requires urgent treatment. 

3. The process of claim 1 wherein each diagnosis is linked to a disclaimer 
1 5 statement. 

4. The process of claim 1 wherein the process further comprises a step to provide 
any information of medications being taken, wherein possible side effects can be linked to the 
medications. 

5. An apparatus or server system for implementing a patient self-diagnosis service 
over a wide area network means of communication, wherein the server system comprises a 
central processing unit, ROM, RAM, and a data storage device, wherein the data storage 
device comprises one or a plurality of databases selected from the group consisting of a 
symptoms database, a disease category database, a medications database, a diseases database, a 
health insurers/systems database, a health care professionals database, and combinations 
thereof, wherein the symptoms database, the disease category database, and the diseases 
database must be present. 

6. A process for designing an algorithm for evidence-based medicine differential 
diagnoses, comprising: 

(a) providing a presenting symptom or group of symptoms; 
30 (b) determining evidence-based probabilities for each diagnosis from medical 

literature or clinical experience sources; 

(c) merging the probabilities with aggregated data into decision alternatives; and 

(d) listing first and preference values as algorithm branchpoint choices. 
7. A process for determining a diagnosis comprising: 
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(a) providing symptomatic information; 

(b) analyzing the symptomatic information using a likelihood ratio algorithm; and 

( c) determining a diagnosis based on a resulting calculation of the likelihood ratio 
algorithm. 
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Fig. 1 



1 / 14 



PSDS Controller 
400 



CLOCK 

445 



APPLIC 
SOFTWARE 
455 



ROM 



440 




RAM 



430 



Central 
Processing 
Unit 



405 




DATA STORAGE DEVICE(S) 
420 



^SYMPTOMS DATABAS E" 



DISEASE CATEGORY DATABASE 



MEDICATIONS DATABASE 



PCT/US00/29648 



CRYPTO 
PROC 

460 




DISEASES DATABASE 



PROFESSIONALS DATABASE 



HEALTH INSURERS/SYSTEMS DATABASE 



422 
423 
424 
425 
426 



COMMUN. 
INTERFACE 
470 



.M Ri 

SUBSTITUTE SHEET (RULE 26) 



BNSDOCID: <WO 013337BA1_I_> 




BNSDOCID: <WO 013337BA1J_> 




BNSDOCID: <WO 013337SA1J_> 



SUBSTITUTE SHEET (RULE 25) 



WO 01/33378 



4 / 14 



• 

PCT/USO0/2964X 




15 a> " 5 

5 a3 c «5 

6 I a i| m 

^ .£ c ro 

^ cp 0 <u a) 



~ o 1=5 

5 CD S 0 

a E « 

O .E *d o 




SUB STITUTE SHEET (RULE 26) 



BNSDOCID: <WO 0133378A1_L> 



WO 01/33378 



5 / 14 



PCT/US00/29648 



Fig. 5 
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Fig. 6 
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Fig. 8 
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Fig. 10 
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Fig. 1 1 
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Fig. 13 
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Fig. 14 



rabular Algorithm^ 
Calculation / 




Read pre-test 
probabilities for all 
possible diagnosis and 
build array to 
contain them 




No 



Yes 



Retrieve all Likelihood 
ratios for this answer 



No 



Multiply each Pretest 
odd by Likelihood ratio 
for that corresponds to 
the possible diagnosis 




Return to Tabular" 
Algorithm y 



BNSOOCID: <WO 0133378A1_I_> 



SUB STITUTE SHEET (RULE 25) 




INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/USOO/29648 



A. CLASSIFICATION OF SUBJECT MATTER " 

IPC(7) :G06F 15/00 
US CL : 705/2 

| According to Intemattonal Patent Classi fication (IPC) or to both n ational classification and IPC 
[ B. FIELDS SEARCHED " " ' 



Minimum documentation searched (classification system followed by classification symbols) 

such documents are included in the fields searched 



U.S. : 705/1, 2. 3. 4 
| Documentation searched other than minimum documentation to the extent that 



I Electronic data base consulted during the international search (name of data base and. 



where practicable, search terms used) 



[C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 

[X 

|x 

[X,P 



Citation of docu ™ent. with indication, where appropriate, of the relevant 



passages 



US 5,299,121 A (BRILL ET AL.) 29 March 1994, See Entire 
Reference 

US 5,915.240 A (KARPF) 22 June 1999, See Entire Reference 

US 6,024,699 A (SURWIT ET AL) 15 February 2000, See Entire 
Reference 



□ 

Further documents are listed in the continuation of Box C. j~j 



Relevant to claim No. 
1-7 

1-7 



- p . 



Special categories of cited documents: 

document defining the general state of the art which is not considered 
0> be of particular relevance «mwoerea 

earlier document published on or after the international filing date * X " 

^^f™** "?y «brow doubts on priority ctaim(s) or which is 

SSL? r^ 1 ^ ?! V^F^on date of another citron or oth£ 
spectal reason (as specified) -y 

mean?* 31 ' refcrrin * "» oral disclosure, use, exhibition or other 

doaiment published prior to rhe international filing date but later than 
the pnonty date claimed « 



Date of the actual completion of the international search 
15 JANUARY 2001 



See patent family annex, 
bier document published after the international filing date 
principle or theory underlying the invention 

document of particular relevance; the claimed invert) 
considered novel or cannot be considered to involve an 
when the document is taken alone 

document of particular relevance; the claimed invention 
considered to involve an inventive step when the < 
h one or more other such documents* such 
s to a person skilled in the art 

of the same patent family 

Date of mailing of the international search report 

SOJANZOQi 



or priority 



Name and mailing address of the ISA/US 
Commissioner of Patents and Trademarks 
Box PCT 

Washington, D.C. 20231 
Facsimile No. (703) 305-3230 
Form PCT/IS A/210 (second sheet) (July 1998)* 



Authorized officer 



SAV MEI^^ ft /ft*&fa& 

Telephone to. ^03) 306-5626 



BNSDOCID: <WO 0133378A1_L> 



